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Introduction 

Some  of  the  complex  issues  of 
future  supercomputing  are  discussed 
in  the  Richard  HiD  and  John  Gustaf¬ 
son  papers  published  in  die  June  1990 
issue  ofSa^en»wipttfi»^g/?et«'eMi.  Both 
papers  contemplate  the  role  of  parallel 
processors  in  future  operational  envi¬ 
ronments.  We  explore  here  a  variation 
of  Gustafson's  suggested  approach, 
heterogeneous  parallelism,  focusing 
in  particular  upon  Distributed  Hetero¬ 
geneous  Supercomputing  (DHS). 
DHS  is  the  use  of  a  heterogeneous 
suite  of  diverse  processors  —  e.g.,  a 
mix  of  vector  and  parallel  computers. 

DHS  is  not  simply  a  LAN  or  a 
WAN  because  it  aims  to  exploit  the  het¬ 
erogeneous  nature  of  the  suite  for  rea¬ 
sons  such  as  access  to  different  data 
bases,  access  to  remote  special  proc¬ 
essors,  or  super-speed  performance. 

Performance  is  the  key  to  the  Su¬ 
perconcurrency  (Super-C)  form  of 
DH5.  because  Super-C  tunes  the  se- 
lf*ction  of  the  different  processors  and 
distributes  the  work  optimally,  primar¬ 
ily  for  maximum  performance  on  the 
problem  at  hand  and  only  secondar¬ 
ily  for  load  balancing. 

Types  of  Concurrency 

There  are  a  number  of  variant  fac¬ 
tors  that  enter  into  classifications  of 
concurrent  (“mulfiplicit/T  process¬ 
ing.  e.g.,  memory  organization  (dis¬ 
tributed.  global,  hierarchical,  etc.)  or 
processor  interconnect  scheme  (bus, 
mesh,  hypcrcube,  etc.).  Perhaps  the 
most  basic  distinction  is  whether  the 
processors  execute  the  fine-grain  par¬ 
allelism  of  same  instruction  on  mul¬ 
tiple  data  (SIMD  or  vector)  or  the 
procedural  parallelism  of  multiple  in¬ 
structions  on  multiple  data  (MD^). 

In  any  case  it  is  only  to  be  expect- 
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ed  that  quite  different  architectures 
would  have  different  computation  pro¬ 
files,  Le.,  be  relatively  effective  or  in¬ 
effective  on  differing  sections  of  the 
overall  computation  spectrum,  as  sug¬ 
gested  heuristkally  in  Figure  1  (where 
‘Computation  Spectrum'  is  intend¬ 
ed  to  suggest  a  wide  range  of  compu¬ 
tation  tasks  and  parameter  ranges). 


In  addition,  It  Is  our  experience 
that  parameters  and  data  lengths  can 
affect  the  dioicc  of  architecturieC;F'ig- 
ure  2  demonstrates  what  we  call  cross¬ 
over  points;  it  shows  a  CRAY  X-MP, 
CON\^  210. 8K  Connection  Machine 
(with  co-processor),  and  4K  DAP  on 
32-bit  SAXPy  (using  the  compiler,  not 
optimized  subroutines).  - 
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SUPERCONCURRENCY,  A  FORM  OF 
DISTRIBUTED  HETEROGENEOUS  SUPERCOMPUTING 

Richard  F.  Freund  and  D.  Sunny  Conwell 
Naval  Ocean  Systems  Center  (NOSC) 

INTRODUCTION  Some  of  the  complex  issues  of  future  supercomputing  are  discussed  in  the  Richard  Hill  and 
John  Gustafson  papers  published  in  the  June  1990  issue  of  SUPERCOMPUTING  REVIEW.  Both  papers 
contemplate  the  role  of  parallel  processors  in  future  operational  environments.  It  is  a  variation  of  Gustafson’s 
suggested  approach,  heterogeneous  parallelism,  that  we  will  explore  here,  in  particular  Distributed  Heterogeneous 
Supercomputing  (DHS).  DHS  is  the  use  of  a  heterogeneous  suite  of  diverse  processors,  e.g.,  a  mix  of  vector  and 
parallel  computers.  DHS  is  not  simply  a  LAN  or  a  WAN  because  it  aims  to  exploit  the  heterogeneous  nature  of  the 
suite  for  reasons  such  as  access  to  different  data  bases,  access  to  remote  special  processors,  or  super-speed 
performance.  Performance  is  the  key  to  the  Superconcurrency  (Super-C)  form  of  DHS,  because  Super-C  tunes  the 
selection  of  the  different  processors  and  optimally  distributes  the  work  primarily  for  maximum  perfor  nance  on  the 
problem  at  hand  (and  only  secondarily  for  load  bdancing). 

TYPES  OF  CONCURRENCY  There  are  a  number  of  variant  factors  that  enter  into  classifications  of 
concurrent  ("multiplicity")  processing,  e.g.,  memory  organization  (distributed,  global,  hierarchical,  etc.)  or  processor 
interconnect  scheme  (bus,  mesh,  hypercube,  etc.).  Perhaps  the  most  basic  distinction  is  whether  the  piocessors 
execute  the  fine-grain  parallelism  of  same  instruction  on  multiple  data  (SIMD  or  vector)  or  the  procedural  parallelism 
of  multiple  instructions  on  multiple  data  (MIMD).  In  any  case  it  is  only  to  be  expected  that  quite  different 
architectures  would  have  different  computation  profiles,  i.e.,  be  relatively  effective  or  ineffective  on  differing  sections 
of  the  overall  computation  spectrum,  as  suggested  heuristically  in  Figure  1  (where  'COMPUTATION  SPECTRUM' 
is  intended  to  suggest  a  wide  range  of  computation  tasks  and  parameter  ranges). 
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Figure  1.  Profiles  of  Processor  Types 


In  addition,  it  is  our  experience  that  parameters  and  data  lengths  can  affect  the  choice  of  best  architecture  type. 
Figure  2  demonstrates  what  we  call  cross-over  points;  it  shows  a  CRAY  X-MP,  CONVEX  210,  8K  Connection 
Machine  (with  co-processor),  and  4K  DAP  on  32-bit  SAXPY  (using  the  compiler,  not  optimized  subroutines). 


AMDAHL'S  LAW  The  need  for  DHS  arises  out  of  Amdahl's  Law,  or  more  precisely,  a  folk  corollary  of  it; 

Any  single  type  of  super-speed  processor  used  on  a  heterogeneous  code  set  often  sp'n  is  most  of  its  time 

on  the  part  it  does  poorest. 

To  illustrate  what  we  mean,  suppose  we  had  profiled  a  large  code  or  set  of  codes  on  which  we  felt  distinct, 
relatively  loosely-coupled  portions  (see  "DINS"  below)  would  best  be  done  on  quite  different  architectures,  e.g., 
vectCM",  SIMD,  f^MD,  special  purpose,  and  data-flow.  Let  us  choose  any  single  processor  type,  say  a  CRAY, 
which  is  primarily  a  vector  engine.  Using  the  CRAY  we  might  drive  the  vectc  portion  of  the  code  down  to 
virtually  no  time,  but  we  would  still  be  left  with  the  non-vector  portions  (soinctimes  mistakenly  simply  called 
"scalar").  A  several-processor  CRAY  might  make  modest  gains  on  the  MTiVlD  portions  and  because  of  its 
relatively  fast  scalar  processor,  it  might  make  some  time  reductions  on  the  rest  of  the  code.  However  it  would  not 
do  nearly  as  well  on  these  other,  non-vector  portions  as  would  machines  (much  less  costly  than  a  CRAY)  designed 
for  those  types  of  computations.  We  would  be  left  with  the  CRAY  spending  most  of  its  time  on  the  code 
portions  where  it  achieves  only  modest  improvements.  Of  course  we  would  obtain  similar  results  if  we  chose  any 
single  processor  type  which  would  do  well  on  its  kind  of  code  and  only  fair  on  other  code  types.  We  believe  that  a 
more  sensible  approach  is  to  build  a  team  of  processor  types  that  match  the  computation  requirements,  as 
illustrated  in  Figure  3. 


Profiling  Example  on  Baseline  Serial  System 

(e.g.,  15%  of  the  compute  time  is  spent  on  code  best  done  on  a  MIMD  machine) 
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Figure  3.  Code  Profiling  and  Machine  Matching 


RESPONSES  This  effects  of  Amdahl's  Law  have  been  considered  before  and  there  are  a  set  of  traditional 
responses. 

i.  One  response  is  to  change  the  relative  percentages  of  the  code  types.  Suppose  we  wish  to  compute  with  only  a 
vector  machine  and  35%  of  the  execution  time  of  our  code  (on  some  baseline  serial  system)  is  naturally 
vectorizable.  Often  one  can  work  on  changing  the  algorithm  and  code  to  increase  this  percentage.  Typically, 
however,  this  approach  achieves  only  modest  benefits,  say  an  increase  to  50%  vectorizable,  and  often  takes  a  great 
deal  of  programmer  effort. 

ii.  Another  response  has  been  single  processor  augmentation,  e.g.,  bringing  in  a  special  second  computer,  such  as 
an  array  processor,  to  handle  suitable  portions  of  the  code.  Typically  this  approach  still  leaves  significant  code 
portions  that  are  not  optimal  matches  to  either  the  main  processor  or  the  special  purpose  machine  (and  therefore 
dominant  in  the  overall  timings). 

iii.  Our  belief  is  that  a  more  natural  response  is  to  use  a  tuned  suite  of  heterogeneous  processors.  Thsi  approach 
attempts  to  cover  all  the  main  types  of  computation  required  and  to  orchestrate  effectively  the  use  of  the  different 
processors.  The  potential  advantages  of  this  are  clear;  we  optimize  the  match  of  all  the  different  portions  of  code 
to  processor  types  (wrt  compute  time)  and  potentially  achieve  much  higher  speeds  than  the  use  of  any  single 
supercomputer,  however  powerful. 

TRENDS  We  perceive  (Figure  4)  four  main  trends  in  the  development  of  supercomputing. 

i.  Device  technology  -  Advances  in  basic  component  technology,  primarily  density,  size,  and  speed. 

ii.  Pipelining  and  vectorization  --  Techniques  for  both  scalar  and  vector  hardware  to  compute  at  the  (asymptotic) 
rate  of  one  result  per  clock  cycle. 

iii.  Homogeneous  parallelism  -  Use  of  one  basic  type  of  parallel  design  to  solve  a  problem  set. 

iv.  Distributed  Heterogeneous  Supercomputing  -  The  combined  and  orchestrated  use  of  different  vector  and 
parallel  proces.sors  to  solve  an  application  set  with  diverse  computation  requirements. 


FORMS  We  sec  three  distinct  and  potentially  complementary  forms  of  Distributed  Heterogeneous 
Supercomputing  in  the  near  future. 

i.  Global  DHS  --  Heterogeneous  processing  done  over  a  large  geographical  area,  e.g.,  the  Concurrent 
Supercomputing  Project  at  JPL/CalTech  (Figure  5A).  This  approach  can  be  used  not  only  to  optimize 
computation  speed,  but  also  to  maximize  the  use  of  remote  data  bases  or  display/interface  capabilities. 

ii.  Site  DHS  --  Mid-sized  DHS  at  one  site.  This  form  is  currently  being  implemented  at  NOSC  (Figure  5B). 

iii.  Micro  DHS  --  DHS  in  the  small,  in  which  all  the  diverse  processors  lake  the  form  of  different  processing 
functionality  in  one  physical  box,  e.g.,  the  Purdue  mixed-mode  PASM  [1].  We  anticipate  seeing  new  ventures  in 
this  arena  in  the  next  few  months,  e.g.,  an  Encore-DAP,  with  the  conscious  aim  of  developing  self-contained, 
tightly-integrated,  and  tailorable  superconcuirent  processing  (Figure  5C). 
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Figure  5.  Forms  of  DHS 


SUPERCONCURRENCY  Superconcurrency  is  a  form  of  DHS  emphasizing  performance  gains  resulting 
from  optimally-configured  vector  and  parallel  mini-supers.  The  Superconcurrency  Research  Team  at  NOSC  is 
evaluating  this  technology  for  Navy  Command  and  Control  iwoblems  as  described  in  [2].  Superconcurrency  is  a 
general  technique  for  matching  and  managing  optimally  configured  suites  of  super-speed  processors.  In  particular 
the  reference  demonstrates  a  general  method  (actually  a  mathematical  program  -  eq  1 .  below)  for  choosing  the 
most  powerful  suite  of  heterogeneous  parallel  and  vector  supercomputers  for  a  given  problem  set,  subject  to  a 


fixed  constraint,  such  ;ls  cost.  The  dual  problem  could  find  a  minimal  cost  configuration  for  a  fixed  speed 
requirement. 


MINIMIZE  T 


(1) 


such  that 


Z  V,  Ci  <  C 

1=1 


where  N  =  #  different  code  types,  M  =  #  different  processor  types,  =  total  #  proces.sors  of  type  k,  c^  =  cost  of 

processor  type  k,  tj  ^  =  time  for  prcKessor  1  on  code  type  k,  T  is  the  total  time  (function  to  be  minimized),  and 

C  is  the  overall  cost  constraint.  This  approach,  called  the  Optimal  Selection  Theory  is  mathematically  dependent 
on  new  methodologies  of  code  profiling  and  analytical  benchmarking,  as  suggested  by  Figures  1  &  3  above. 


DINS  OR  DYNAMIC  OPTIMIZATION  One  of  the  most  active  current  research  areas  of  the  NOSC 
Superconcurrency  Research  Team  has  been  the  development  of  the  Distributed  Intelligent  Network  System 
(DINS)  concept.  DINS  will  be  a  reasoning  system,  built  upon  an  existing  distributed  O/S,  that  u.ses  information 
from  Code  Profiling,  Analytical  Benchmarking,  and  network  bandwidth  to  optimally  manage  a  network  of 
heterogeneous,  high-performance,  concurrent  processors  and  assigns  portions  of  code  to  appropriate  processors. 
Superconcurrent  implementations  will  work  at  the  lowest  level  granularity  compatible  with  the  bandwidths 
available  at  any  given  site  and  the  degree  of  coupling  required  by  the  various  code  modules.  Put  another  way. 
equation  1  above  will  actually  use  t'ij  where  the  t'  reflect  not  only  the  actual  compute  time  for  processor  i  on 
code  type),  but  the  required  interprocessor  communication  time  as  well: 


MINIMIZE  T 


N 


J=1 


t’ij 

min 

l<i<M  Vj 


(2) 


In  a  general  sense,  this  approach  is  similar  to  current  research  in  load  balancing  and  priority  assignment. 

However  the  information  sources  will  be  the  Profiling,  Benchmarking,  and  bandwidth  factors  with  the  primary 
aim  of  optimal  matching  of  code  portions  to  processors  rather  than  (the  secondary)  factors  of  load  balatKing  and 
priority  assignment.  Since  DINS  will  reason  about  proces.sors  actually  available  to  it,  we  have  the  potential  to 
achieve  configuration  control  at  different  sites  even  though  there  may  be  a  different  superconcurrent  suite  at  each. 
Similarly  DINS  will  continue  to  function  and  assign  a  second  best  processor  if  a  first  choice  is  unavailable  or 
down.  Thus  DINS  is  robust  and  survivable.  Likewise  it  is  compatible  with  evolutionary  development;  when  a 
new  processor  is  introduced  because  of  changing  technology,  the  old  benchmarking  data  can  be  replaced  with  the 
new.  The  features  of  robustness,  configuration  control,  survivability,  tailorability,  and  evolutionary  development 
are  essential  for  many  Navy  problems.  We  call  DINS  dynamic  optimization  since  it  will  dynamically  task,  in  an 
optimal  way,  the  backend  suite  of  heterogeneous,  superconcurrent  processors  that  are  chosen  by  the  Optimal 
Selection  TTieory. 
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h  less  costly  than  a  Cray)  deeign- 
r  those  types  of  computations. 

Ve  would  be  left  wift  the  Cray 
ling  most  of  its  time  on  the  code 
3ns  where  it  achieves  only  mod- 
mprovements.  Of  course  we 
1  obtain  »milar  results  if  we 
:  any  single  processor  type  that 
i  do  well  on  its  kind  of  code  and 
fair  on  other  code  types.  We 
e  that  a  more  senile  approach 
luild-a  team  of  processor  types 
tatch  the  coim>utation  require- 
i,  as  illustrated  in  Figure  3. 

ponses 

A 

tiis  effect  of  Amdahl's  Law  has 
ronsidered  before  and  there  is 
I  traditional  re^x)nses. 
oc  re^nse  is  to  chan^  the 
lative  percentages  of  the  code  . 


and  35  percent  of  the  execution 
time  of  our  code  (on  some  base- 
Bne  serial  system)  is  natiirahy  vec- 
tori2able.  Often  one  can  work  on 
dianging  tiie  algorithm  and  code 
to  increase  this  percentage.  Typi¬ 
cally,  however,  this  approach 
achieves  only  modest  benefits, 
say  an  increase  to  50  percent 
vectorizable,  and  often  takes  a 
great  deal  of  programmer  effort 

2)  Another  response  has  been  sin- 
gie-proccssor  augmentation.  c.g., 
brinsnng  in  a  special  second  com¬ 
puter,  such  as  an  array  processor, 
to  handle  suitable  portions  of 
the  code.  Typically  this  approach 
still  leaves  significant  code  por¬ 
tions  that  (tfc  not  optimal  match¬ 
es  to  either  tiie  main  processor  or 
the  spedal-purpose  machine  (and 
therefore  dominant  in  the  overall 
timings). 

3)  Our  belief  is  that  a  more  natural 
response  is  to  use  a  tuned  suite 
of  heterogeneous  processors. 
This  approach  attempts  to  cover 
all  the  main  tjTjes  of  compu¬ 
tation  required  and  to  orches- 

.  trate  effectively  the  use  of  the  dif¬ 
ferent  processors.  The  potential 
advantages  ere  dear.  We  optimize 
;  tfic  match  of  all  the  different  por- 
rW/i  tioJis  of  code  to  processor  types 


single  supercomputer,  however 
powerful 

Trends 

Wc  perceive  four  main  trends  in 
the  devdopment  of  supercomputing, 
shown  in  Figure  4. 

1)  Device  technology  —  Advances 
in  basic  component  technology', 
primarily  density,  size  and  speed. 

2)  Bpelining  and  vectorization  — 
Techniques  for  both  scalar  and 
vector  hardware  to  compute  at 
the  (asymptotic)  rate  of  one  re¬ 
sult  pjer  dock  cycle. 

3)  Homogeneous  parallelism — Use 
of  one  basic  type  of  parallel  de¬ 
sign  to  solve  a  problem  seL 

4)  Distributed  Heterogeneous  Su- 
pcrcomputing  —  The  combined 
and  orchestrated  use  of  different 
vector  and  parallel  processors  to 
solve  an  application  set  with  di¬ 
verse  computation  requirements. 

Forms 

We  see  three  distinct  and  poten¬ 
tially  oon^lementary  forms  ol  Distrib¬ 
uted  Heterogeneous  Supercomputing 
in  the  near  futtire. 

1)  Global  DHS  —  Heterogeneous 
processing  done  over  a  large  geo- 
^^j.gmphical  area,  e.g.,  the  Concur- 

ripnt'  TV--* — * 


t)cs.  Suppose  we  wish  to  c6i^  ^Igg^iidpoteniiaDyachi^^ 

te  with  only  a  vector  machihe^i^^^  speeds  than  the  use  of  any 
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Hgure  4:  Supercbiitputing  Trends 
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JPI/CalTech  (Figure  SA).  This 
approach  can  be  used  not  only 
to  optunize  computation  speed, 
but  also  to  oaaximize  the  use  of 
remote  databases  or  display/in¬ 
terface  capabilities, 

2)  Site  DHS  —  Mid-^ed  DHS  at 
one  site.  This  form  is  currently 
being  implemented  at  NOSC 
(Figure  5B). 

3)  Micro  DHS  —  DHS  in  the  small, 
In  which  all  the  diverse  proces¬ 
sors  take  the  form  of  different 
processing  functionality  in  one 
physical  box,  eg,,  the  Purdue 


conscious  aim  ofdcveloping  self- 
contained,  tightly-integrated,  and 
taflorahle  superconcurrent  proc¬ 
essing  (Figure  5Q. 

Superconcurrency 

Superconcurrency  is  a  form  of 
DHS  emphaaangp^ormance  gains 
resulting  fipom  optimally-configured 
vector  and  parallel  mini-supers.  The 
Superconcurrency  Researdi  Team  at 
NOSC  is  evaluating  this  technology 
for  Navy  Command  and  Control  pro^ 
lems  as  described  in  {2], 


;the  reference  demonstra.es  agra^ 
'.method  (actually  a 
.program  —  Equation.  1,  bclw)]f0r 
choosing  the  most  powerfiil «mtc{crf 
lieterogencous  parallel  ad^  ^y^oir 
supercomputers  for  a  given  jroblcm 
set,  subject  to  a  fixed  constrain^^^  ; 
as  cost  The  dual  problem  aiSd&d 
a  minimal  cost  configuratioirjpra " 
fixed  speed  requirement  "  V, 

MINIMIZE  (r=  V  ) 

\vi  / 

M 

Buch  that  y.  Vi  Ci  <  (? 

(1) 

where  N  ■  #  different  code  tj^pes, 
M«=#  different  processor  types, 
total  #  processors  of  .  type  ,  k, 
Cij*=  costofjMxiceEsor^Tpely  fu.  -time 
for  processor  1  on  code  tjije  k.  Tis 
the  total  time  (function  &  be  mini- 
mized),  and  C  is  the  overall  cost  con¬ 
straint  This  approach,  called  the 
Optimal  Selection  Theory  is  mathe¬ 
matically  dependent  on  newme&od- 
ologies  of  code  profiling  and  analyti¬ 
cal  benchmarking,  as  suggested  by 
Figures  1  &  3  above. 

DINS  or  Dynamic 
Optimization 

One  of  the  most  active  current 


mixed-mode  PASM 11],  We  anti-  Superconcurrency  is  a  general  researchareasoftheNOSCSuper- 
dpate  seeing  new  ventures  in  this  technique  for  matching  and  manag-  concurrency  Research  Team  has  been 
arena  in  the  next  few  months,  ing  optimally  configured  suites  of  the  development  of  the  Distributed 
e-g,,  an  Encore-DAP,  with  the  super-spe^proce^ri.Inparticular  Intelligent  Network  System  (PINS) 


SUPERCONCURRENCY 


snccpt.  DINS  will  be  a  reasoning 
rstcm,  built  upon  anydBSBhg  distrib- 
tcd  O/S,  that  uses  information  from 
ode  Profiling,  Analytical  Bcndtmark- 
g,  and  network  bandwiddi  to  optimal- 
•  manage  a  network  afhctcrogeneous, 
igh-performance,  concurrent  proc¬ 
tors.  It  assigns  portions  of  code  to 
ppropriatc  processors. 

SrqxroQTifCurrrntirnpleinentations 
in  work  at  the  lowest  level  of  gran  u- 
xity  compatible  widi  the  bandwidths 
railable  at  any  given  site  and  the  de- 
ree  of  coupling  required  by  flie  vari- 
us  code  modules.  Put  another  way, 
quation  1  above  win  actuaDy  use  f,  ,j 
the  f  reflects  not  onty  the  ac- 
lal  compute  trmeioT  processor  i  on 
kle  typej,  but  the  required  interproc- 
isor  communication  time  as  welt 

UNiMias  *T=  y  ^ 

^XSisM  V  Vi  / 

In  a  general  sense,  this  aj^roach 
similar  to  current  research  in  load 
alandng  and  priority  assignment 
’owever,  the  information  sources  will 


be  the  profiling,  benchmarking  and 
bandwidth  factors  with  the  primary 
aim  of  optimal  matching  of  code  por¬ 
tions  to  processors  rather  than  (the 
secondary)  factors  of  load  balanong 
and  priority  assignment 

Since  DINS  will  reason  about  proc¬ 
essors  actually  available  to  it,  we  have 
the  potential  to  achieve  configuration 
control  at  different  sites  even  though 
there  may  be  a  different  supcrconcur- 
rent  suite  at  each.  Similarly,  DINS  will 
continue  to  fiinction  and  assign  a 
secondbest  processor  if  a  first  choice 
is  unavailable  or  do^  ■ 

Thus,  DINS  Is  robust  ^  surviv- 
able.  It  is  in  addition  compatible  with 

evolutionary  devdopraent ‘When  a  new 
processor  is  introduced  because  of 
changing  technology,  the  old  bench¬ 
marking  data  can  be  replaced  with  the 
new.  The  features  of  robustness,  con¬ 
figuration  control,  stirrivabiEty,  tzdlor- 
ability,  and  evohitibnary  devetopment 
are  essential  for  many  Navy  prob¬ 
lems.  We  call  DINS  dynamic  optimi¬ 
zation  since  it  will  dynamically  task, 
in  an  optimal  way,  the  back-end  suite 


of  heterogeneous,  supcrconcurrcnt 
processors  that  are  chosen  by  the 
Optimal  Selection  Theory. 
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